SEALS Semantic Evaluation at Large Scale FP 7 – 238975 D 12 . 3 Results of the first evaluation of matching tools
نویسندگان
چکیده
for dissemination) This deliverable reports the results of the first SEALS evaluation campaign, which has been carried out in coordination with the OAEI 2010 campaign. A subset of the OAEI tracks has been included in a new modality, the SEALS modality. From the participant’s point of view, the main innovation is the use of a web-based interface for launching evaluations. 13 systems, out of 15 for all tracks, have participated in some of the three SEALS tracks. We report the preliminary results of these systems for each SEALS track and discuss the main lesson learned from to the use of the new technology for both participants and organizers of the OAEI.
منابع مشابه
SEALS Semantic Evaluation at Large Scale FP 7 – 238975 D 12 . 1 Evaluation Design and Collection of Test Data for Matching Tools
for dissemination) This deliverable presents a systematic procedure for evaluating ontology matching systems and algorithms, in the context of SEALS project. It describes the criteria and metrics on which the evaluations will be carried out and the characteristics of the test data to be used, as well as the evaluation target, which includes the systems generating the alignments for evaluation.
متن کاملSEALS Semantic Evaluation at Large Scale FP 7 – 238975 D 10 . 1 Evaluation Design and Collection of Test Data for Evaluating Ontology Engineering
for dissemination) This deliverable reviews the current state on ontology engineering tool evaluation and presents the definition of the evaluations and test data that will be used in the first SEALS Evaluation Campaign over ontology engineering tools, which will target the conformance, interoperability and scalability of such tools.
متن کاملLarge Scale FP 7 – 238975 D 12 . 5 Iterative implementation of services for the automatic evaluation of matching tools - v 2 . 0 - FR
for dissemination) This deliverable reports on the current status of the service implementation for the automatic evaluation of matching tools, and on the final status of those services. These services have been used in the third SEALS evaluation of matching systems, held in Spring 2012 in coordination with the OAEI 2011.5 campaign. We worked mainly on the tasks of modifying the WP12 BPEL work-...
متن کاملSemantic Evaluation at Large Scale FP 7 – 238975 D 11 . 1 Evaluation design and collection of test data for advanced reasoning systems
for dissemination) This deliverable reviews the current state on advanced reasoning systems evaluation and presents the definition of the evaluations and test data that will be used in the first SEALS Evaluation Campaign. The tests cover interoperability and performance of advanced reasoning systems.
متن کاملFP 7 – 238975 D 12 . 2 Services for the automatic evaluation of matching tools v 1
for dissemination) In this deliverable we describe a SEALS evaluation service for ontology matching that is based on the use of a web service interface to be implemented by the tool vendor. Following this approach we can offer an evaluation service before many components of the SEALS platform have been finished. We describe both the system architecture of the evaluation service from a general p...
متن کامل